Telegram Group & Telegram Channel
Telegram Group » Hong Kong » Data Science by ODS.ai 🦜 » Telegram Webview » Post 2251
Data Science by ODS.ai 🦜
🌟 DeepCoder-14B

New code reasoning LLM fine-tuned from DeepSeek-R1-Distill-Qwen-14B using distributed RL with GRPO+ and iterative context lengthening. Trained on ~24K coding problems (TACO-Verified, PrimeIntellect SYNTHETIC-1, LCB v5), it improves Pass@1 on LiveCodeBench v5 to 60.6%, +7.6% over base and on par with OpenAI o3-mini.

- GRPO+: removes KL/entropy loss for stability; adds offline difficulty filtering, DAPO-inspired loss masking, and reward clipping.
- Iterative context scaling: 16K→32K→64K generalization with improved long-context reasoning.

Eval: Strong results on LiveCodeBench, Codeforces, HumanEval+

Open weights🔥

https://huggingface.co/agentica-org/DeepCoder-14B-Preview

@opendatascience
Please open Telegram to view this post
VIEW IN TELEGRAM
www.tg-me.com/hk/Data Science by ODS ai 🦜/com.opendatascience/2251
3.1K views



tg-me.com/opendatascience/2251
Create:
Last Update:

🌟 DeepCoder-14B

New code reasoning LLM fine-tuned from DeepSeek-R1-Distill-Qwen-14B using distributed RL with GRPO+ and iterative context lengthening. Trained on ~24K coding problems (TACO-Verified, PrimeIntellect SYNTHETIC-1, LCB v5), it improves Pass@1 on LiveCodeBench v5 to 60.6%, +7.6% over base and on par with OpenAI o3-mini.

- GRPO+: removes KL/entropy loss for stability; adds offline difficulty filtering, DAPO-inspired loss masking, and reward clipping.
- Iterative context scaling: 16K→32K→64K generalization with improved long-context reasoning.

Eval: Strong results on LiveCodeBench, Codeforces, HumanEval+

Open weights🔥

https://huggingface.co/agentica-org/DeepCoder-14B-Preview

@opendatascience

BY Data Science by ODS.ai 🦜




Share with your friend now:
tg-me.com/opendatascience/2251

View MORE
Open in Telegram


Data Science by ODS ai 🦜 Telegram | DID YOU KNOW?

Date: |

At a time when the Indian stock market is peaking and has rallied immensely compared to global markets, there are companies that have not performed in the last 10 years. These are definitely a minor portion of the market considering there are hundreds of stocks that have turned multibagger since 2020. What went wrong with these stocks? Reasons vary from corporate governance, sectoral weakness, company specific and so on. But the more important question is, are these stocks worth buying?

Data Science by ODS ai 🦜 from hk


🌟 DeepCoder-14BNew code reasoning LLM fine-tuned from DeepSeek-R1-Distill-Qwen-14B using distributed RL with GRPO+ and iterative context lengthening. Trained on ~24K coding problems (TACO-Verified

 Data Science by ODS.ai 🦜 TG
Webview: 2251
Data Science by ODS.ai 🦜.Telegram Webview
Data Science by ODS.ai 🦜 Telegram TG Channel
Telegram Updated:
Telegram Data Science by ODS.ai 🦜
FROM USA